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A MAX-CUT FORMULATION OF 0/1 PROGRAMS 


JEAN B. LASSERRE 

Abstract. We show that the linear or quadratic 0/1 program 
P ; min{c^x + x^Fx : Ax = b; x € {0, 1}"}, 

can be formulated as a MAX-CUT problem whose associated graph is 
simply related to the matrices F and A^A. Hence the whole arsenal 
of approximation techniques for MAX-CUT can be applied. We also 
compare the lower bound of the resulting semidefinite (or Shor) relax¬ 
ation with that of the standard LP-relaxation and the first semidefinite 
relaxations associated with the Lasserre hierarchy and the copositive 
formulations of P. 

Keywords: linear and quadratic 0/1 programs; MAX-CUT problem; 
LP- and semidefinite relaxations. 


1. Introduction 

Consider the linear or quadratic 0/1 program P defined by: 

(1.1) P: /* = min { c'^x -h x^Fx : A X = b; x G {0, 1}” } 

X 

for some cost vector c G M”, some matrix A G some vector b G Z”^, 

and some real symmetric matrix F G If F = 0 then P is a 0/1 linear 

program and a quadratic 0/1 program otherwise. Obtaining good quality 
lower bounds on f* is highly desirable since the efficiency of Branch & Bound 
algorithms to solve large scale problems P heavily depends on the quality 
of bounds of this form computed at nodes of the search tree. 

To obtain lower bounds for 0/1 programs (11.11) one may solve a relaxation 
of P where the integrality constraints x G {0, !}”■ are replaced with the box 
constraints x G [0,1]”. If F = 0 the resulting relaxation is linear whereas 
if F is positive definite it is a (convex) quadratic program. If F is not 
positive semidefinite then one may also solve a convex quadratic program but 
now with an appropriate convex quadratic underestimator x^Fx of x^Fx 
on [0,1]”". An alternative is to consider an equivalent formulation of P 
as a copositive conic program as advocated by Burer [4] and compute a 
sequence of lower bounds by solving an appropriate hierarchy of LP- or 
SDP-relaxations associated with the copositive cone (or its dual). For more 
details on the latter approach the interested reader is referred to e.g. De 
Klerk and Pasechnik [5], Diir [6], Bomze [2], and Bomze and de Klerk [3]. 

Contribution. The purpose of this note is to show that solving P is 
equivalent to minimizing a quadratic form in n+1 variables on the hypercube 
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{—1, (and the quadratic form is explicit from the data of P). In other 

words P can be viewed as an explicit instance of the MAX-CUT problem. 
This idea had been already briefly mentioned in Rendl m in the context of 
partitioning and ordering problems. Hence the MAX-CUT problem which at 
first glance seems to be a very specihc combinatorial optimization problem, 
in fact can be considered as a canonical model of linear and quadratic 0/1 
programs. In particular, to each linear or quadratic 0/1 program (ll.ljl one 
may associate a graph G = {V,E) with n-|- 1 nodes and {i,j) € E whenever 
a product XiXj has a nonzero coefficient in some quadratic form built upon 
the data c, b,F and A of (jl.ll) . (Among other things, the sparsity of G 
is related to the sparsity of the matrices F and A^A.) Then solving (HI) 
reduces to finding a maximum (weighted) cut of G. 

Therefore the whole specialized arsenal of approximation techniques for 
MAX-CUT can be applied. In particular one obtains a lower bound // 
on /* by solving the standard (Shor) SDP-relaxation associated with the 
resulting MAX-CUT problem while solving higher levels of the associated 
Lasserre-SOS hierarchy [SIE] would provide a monotone nondecreasing se¬ 
quence of improved lower bounds // < < /*, d = 2 ,..., but of course 

at a higher computational cost. Alternatively one may also apply the Han- 
delman hierarchy of LP-relaxations as described and analyzed in Laurent 
and Sun [12]. For more details on recent developments on computational 
approaches to MAX-CUT the interested reader is referred to Palagi et al. 
m- In addition one may also obtain performance guarantees d la Nesterov 
m or their improvements by Marshall m- Finally, the same methodol¬ 
ogy also works for general 0/1 optimization problems with feasible set as in 
dm) and polynomial criterion / € M[x] of degree d > 2, except that now 
the problem reduces to minimizing a new polynomial criterion /(x) on the 
hypercube {—1,1}*^ (and not a MAX-CUT problem any more as the degree 
of / is larger than 2). 

Numerical experiments. For 0/1 linear programs (F = 0) the lower 
bound // can be better than the standard LP-relaxation which consists 
in replacing the integrality constraints x € {0,1}"' with the box [0, l]'^, as 
shown on a (limited) sample of 0/1-knapsack-type examples. In fact // is 
almost always better than the lower bound obtained from the first SDP- 
relaxation of the Lasserre-SOS hierarchy applied to the initial formulation 
(HD of the problem (an SDP of same size which is a basic quadratic re¬ 
laxation of the initial problem). This is good news since typically the SOS- 
hierarchy is known to produce good lower bounds for general polynomial 
optimization problems (discrete or not) even at the first level of the hierar¬ 
chy. Even more, the first level SDP-relaxation has the celebrated Goemans 
&: Williamson performance guarantee (~ 87%) when the matrix Q (associ¬ 
ated with the quadratic form) has nonnegative entries and a performance 
guarantee ~ 64% when Q ^ 0. (However note that the matrix Q associated 
with our MAX-CUT problem equivalent to the initial 0/1 program (jl.ip 
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does not have all its entries nonnegative.) For quadratic 0/1 knapsacks, f* 
is also better than the lower bound obtained by relaxing {0,1}” to [0,1]”, re¬ 
placing F with a convex quadratic underestimator, and solving the resulting 
convex quadratic relaxation. 

We have also considered the MAX-CUT formulation of the fe-cluster prob¬ 
lem p = min{x^Ax : e^x = A:;x E {0, !}"■} where A; E N and A is some real 
symmetric matrix, for n = 70 and n = 100 variables and with various per¬ 
centages of zero entries in the matrix A. In all examples the optimal value 
of the Shor relaxation was almost indistinguishable of the first semidefinite 
relaxation of the Lasserre-SOS hierarchy applied to the initial formulation. 
We have also compared the Shor relaxation with a quadratic convex relax¬ 
ation of the problem. The former always provides better lower bounds (and 
sometimes significantly better). At last we have also compared the Shor 
relaxations respectively associated with the MAX-CUT and copositive for¬ 
mulations. Again the respective optimal values are very close (less than 1% 
relative difference and in a few cases the former is significantly better). 


2. Main result 

Denote by Z the set of integer numbers and N C Z the set of natural 
numbers. Let P be the 0/1 program defined in (jl.ip with = F E 
A E c E and b E Z™. Let |c| := (|q|) E M". With e E Z*^ being 

the vector of all ones, notice first that P has an equivalent formulation on 
the hypercube {—1,1}*^, by the change of variables x := 2x — e. Indeed, A, 
b, c and F now become A/2, b — Ae/2, (c -|-e^F)/2 and F/4 respectively. 

Therefore from now on we consider the discrete program; 


(2.1) P: f* = min { c^x-|-x^Fx : Ax = b}, 

on the hypercube { — 1,1}”, with A E c E M"", b E Z™', and F^ = 


F E 

With c and F, let us associate the scalars: 


- 

’^c,F — 

min { c^x -|- (X, F) : 

■ 1 x"^ ■ 

X X 

hO; Xu = 1, i = l,.. 

. ,n} 

0 to 

II 

max { c^x -|- (X, F) : 

■ 1 x^ ■ 
X X 

h 0; Xu = 1, i = 1,. 

. ,n} 

(with = 

= X) and let 




(2.2) 

P(C,F) 

:= max r* ^ . 

4 = 1,2 ’ 



It is straightforward to verify that 

(2.3) p{c, F) > max { |c^x -|- x^Fx | : x E {— 1,1}" }, 
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and /9(c, F) = |c| if F = 0. Moreover each scalar r* p can be computed by 
solving an SDP which is the Shor relaxation (or first level of the Lasserre- 
SOS hierarchy [8l|9]) associated with the problems min (max){c^x + x^Fx : 
xG{-i,in. 

2.1. A MAX-CUT formulation of P. 


Lemma 2.1. Let P be as (E2P and let p{c,F) be as in 112.B) . If f* < +oo 
then f* is the optimal value of the quadratic minimization problem, i.e., 

(2.4) f* = 9:= min c’^x + x^Fx + (2/9(c,F) + 1) • llAx — blP. 
Moreover P has no feasible solution (f* = +ooJ if and only if 9 > p(c,F). 


Proof. Let A := {x € {—1,1}"" : Ax = b} be the feasible set of P dehned 
in (j2.ip . and let / : M"—be the function 

(2.5) X !-)• /(x) := c’^x + x^Fx -|- (2 p{c, F) + 1) ■ || Ax — b|p. 

On {—1, !}"■ one has maxjc^x + x^Fx : x € { — 1,1}”} < p{c, F), and 
||Ax-bf>l, VxG {-1,1}”\A, 
because A G •^rnxn ^ ^ Therefore, 
r f'^x’ —l— on 

(2.6) /(x) I > 2 p{c, F) + 1 > p{c, F) on {-1,1}” \ A. 

From this and c'^x + x^Fx < p{c, F) on A, the result follows. □ 

Next, let Q : be the homogenization of the quadratic polynomial 

/, i.e., the quadratic form (^(x, xq) := or in explicitly form: 

(2.7) Q(x, xq) = xq c'^x + x^Fx + (2 p{c, F) + 1) • || Ax — xq b||^. 
Observe that Q(x, 1) = /(x). 

Theorem 2.2. Let f* = min{c^x + x^Fx : Ax = b;x G {—1, !}"■} and let 
Q be the quadratic form in ?[ ). If f* < +oo then 

(2.8) f* = 9:= min Q(x, xq), 

that is, f* is the optimal value of the MAX-CUT problem associated with 
the quadratic form Q. Moreover f* = +oo if and only if 9 > p{c,F). 


Proof. Let / be as in ()2.5p . By definition of Q, 

(2.9) min /(x) = min {(^(x, xq) : xq = 1 }• 

xG{- 1,1}" (x,a;o)e{—l,!}’»+! 

On the other hand, let (x*,Xq) G {—1,1}”^^ be a global minimizer of 
min{(5(x, xo) : (x, xq) G {—1, Then by homogeneity of Q, (—x*,— xq) 

is also a global minimizer and so one may decide arbitrarily to hx xq = 1. 
That is. 


min 

(x,xo)G{—1,1}'*+! 


Q(x,xo) 


min {Q(x, xo) : xq 
(x,a:o)G{-l,l}’*+l 
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which combined with (12.9|) and Lemma l2 .1 1 yields the desired result. □ 

Next, write Q(x, xq) = (x, xo)Q(x, xq)'^ for an appropriate real symmetric 
matrix Q G and introduce the semidefinite programs 

(2.10) min {(Q, X) : X ^ 0; = 1, i = 1,..., n + 1} 

X. 

with optimal value denoted by minQ+, and 

(2.11) max {(Q, X) : X ^ 0; Xu = 1, z = 1,..., n + 1} 

X. 

with optimal value denoted by maxQ"^. 

Proposition 2.3. Let P be the problem defined in \2. II) with optimal value 
f* and let p{c,F) be as in f2.2l) . If f* < +oo then 
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(2.12) min Q+ < /* < — min Q+ + (1-) max Q^, 

Vr TT 

where Q is the real symmetric matrix asociated with the quadratic form (f£ 7| ) 
and min Q+ (resp. max is the optimal value of the semidefinite program 
112. IC^) (resp. 112.11]) ). Moreover, z/minQ+ > /9(c, F) then P has no feasible 
solution (i.e., f* = +ooj. 

Proof. The bounds in (j2.12p are from Nesterov |14] . In addition, one may 
also use the bounds provided in Marshall m which sometimes improve 
those in (j2.12p . Next, let A := {x € {—1,1}*^ : Ax = b} and assume that 
A / 0. Then by (12.31) and (12.6p . minQ+ < f* < p{c,F). Therefore A = 0 
if min Q_|_ >/9(c, F). □ 

The quality of the upper bound in (j2.12p depends strongly on the magni¬ 
tude of the “penalty coefficient” 2p{c, F) -|-1 in the definition of the function 
/ in (j2.5p . Whether or not the penalty parameter p(c, F) could be taken 
smaller (at least in some cases) has not been investigated and is beyond the 
scope of this paper. However for a practical use of relaxations what matters 
most is the quality of the lower bound min Q+ which in principle is very 
good for MAX-CUT problems (even if Q ^ 0 or Q ^ 0). For instance in 
a Branch & Bound algorithm the lower bound minQ-|_ has an important 
impact in the pruning of nodes in the search tree. 

2.2. Sparsity. Hence to each 0/1 program (II.ip one may associate a graph 
G = iy,E) with n -|- 1 nodes and an arc (i,j) G E connects the nodes 
i,j G V if and only if the coefficient Qij of the quadratic form Q(x, xq) 
does not vanish. Sparsity properties of G are of primary interest, e.g. for 
computational reasons. From the definition of the matrix Q, this sparsity 
is in turn related to sparsity of the matrix F -|- (2p(c, F) -|- 1) • A^A, hence 
of sparsity of F and A^A. 

In particular, two nodes i,j are not connected if F^- = 0 and AkiA^j = 0 
for all k = 1,... ,m, that is, in any of the constraints Ax = b, at most 
one of the two variables {xi,Xj) appears (a structural condition). A weaker 
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condition (non-structural as it depends on values of entries of A) is that 
Xyfc ^ki-^kj — 0. 

2.3. Extension to ineqnalities. Let /(x) := c^x + x^Fx for some c € M"" 

and some = F G and consider the problem: 

(2.13) P: /* = min{/(x) : Ax < b; x € {0, }, 

X 

for some cost vector c G Z”, some matrix A G Z™^”, and some vector 
b G Z™. We may and will replace (j2.13p with the equivalent pure integer 
program: 

P': /* = min{/(x) : Ax + y = b; x G {0,1}”; y G N™ }. 

x,y 

Next, as X G {0,1}” we can bound each integer variable yj by Mj := bj — 
min{Aj x : x G {0, 1}”}, j = 1, ..., m, where Aj denotes the j-th. row vector 
of the matrix A; and in fact Mj = bj — min[0, Ajj], j = 1,..., m. Then 
we may use the standard decomposition of yj into a weighted sum of boolean 
variables : 

yj = '^2^Zjk, Zjk e{0,lV, j = 
k=0 

(where Sj := [log(Mj)]) and replace (I2.13p with the equivalent 0/1 program: 

f* = min{/(x) : AJx+ ^2^ Zjk = bj, j < m; (x,z) G {0,1}”+^}, 

k=0 

(where s := X]j(l + Sj)) which is of the form (ll.ip . 

2.4. Extension to polynomial programs. Let / G M[x] be a polynomial 
of even degree d > 2, written as 

X ^ /(x) = ^ /aX", 

for some vector of coefficients f = (fa) G (with s{d) = Given 

a sequence y = (ya), « € N"", define the Riesz functional Ly : M[x]— by: 

f ^ Lyif) = ^ focVo,, /gM[x]. 

aGN" 

Consider the polynomial program: 

(2.14) /* = min{/(x) : Ax = b; xG{-1,1}”}, 

on the hyper cube {—1,1}"'. Let d' := d/2, x i->- 5 j(x) := 1—j = 1,..., n, 
and with / let us associate the scalars: 

r) = min{Ly(/) : Mrf/(y) ^ 0; Md'-i(5iy) = 0, j = 1,... ,n} 

r) = max{Ly(/) : Mrf/(y) ^ 0; y) = 0, j = 1,... ,n} 
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where M^/(y) (resp. y)) is the moment matrix (resp. localizing 

matrix) of order d' associated with the real sequence y = (ya), a G (resp. 
with the sequence y and the polynomial gj). It turns out that (resp. 
is the optimal value of the first SDP-relaxation of the Lasserre-SOS hierar¬ 
chy associated with the optimization problem min (resp. max){/(x) : x G 
{ —1,1}”'} and so < min{/(x) : x G {—1,1}"'} whereas r'j > max{/(x) : 
X G {—1,1}""}- For more details, see e.g. [TOKIT]. Next, if we define 

(2.15) p/ := max|r)|, 

then it is straightforward to verify that Pf > max{ |/(x)| : x G { — 1,1}”}. 
Then we have the following analogue of Lemma 12.11 

Lemma 2.4. Let f* be as Ili2.14\ ) and pj as in 112.1,'^) . If f* < -|-oo then 

(2.16) f* = p:= min /(x)-|-(2pf-|-1) • ||Ax — b|p 

(a polynomial optimization problem on{—1, l}”j. Moreover f* = -|-oo if and 
only if p> Pf. 

The proof being almost a verbatim copy of that of Lemma l2.11 is omitted. 

As for the quadratic case and with same arguments, one may also show 
that if d is even, the polynomial optimization problem (j2.16|) is equivalent 
to minimizing the homogeneous polynomial / of degree d on the hypercube 
{—1, l}”"*"^, where 

(x,a:o) ^ /(x) := x^fix/xo) -h (2p/ -h 1)xq~‘^ ■ ||Ax - xobf. 

But since it is not a MAX-CUT problem, to obtain a lower bound on f* one 
may just as well consider solving the first level of the Lasserre-SOS hierar¬ 
chy associated with (j2.16l) or even directly with (|2.14p . The advantage of 
using the formulation (j2.16l) is that one always minimizes on the hypercube 
{—1,1}” instead of minimizing on the subset {—1,1}” n {x : Ax = b} of 
the hypercube which is problem dependent. 

3. Some numerical experiments 

All semidefinite programs were solved by using the GloptiPoly software 
dedicated to solving the Generalized Problem of Moments and which im¬ 
plements the Lasserre-SOS hierarchy of semidefinite relaxations. For more 
details the interested reader is referred to Henrion et al. [7]. Typically, for a 
MAX-GUT problem of size n = 100, solving the Shor relaxation with Glop¬ 
tiPoly (and calling the semidefinite solver MOSEK [T]) takes approximately 
42s on a Macbook-pro lap-top with Intel Gore i5 processor at 2.6 GHz. 

3.1. Some 0/1-knapsack examples. To test the efficiency of the MAX- 
CUT formulation we have first considered 0/1-knapsack problems of small 
size (up to n = 15 variables) and compared the first semidefinite relaxation 
(or Shor-relaxation) of the MAX-CUT formulation (12.4p with some other 
relaxations, and in particular with: 
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- The LP-relaxation of (12.11) (when F = 0) which consists of replacing the 
constraint x € {—1, !}”■ with x G [—1, !]”■, and 

- The first semidefinite relaxation of ()2.ip in the Lasserre-SOS hierarchy. 

Example 3.1. To evaluate the quality of the lower bound obtained with the 
MAX-CUT formulation consider the following simple linear knapsack-type 
examples: 

(3.1) min {c^x : a^x = 6; x G {—1, !}"■ }, 

on {—1, !}"■, with 4 and 10 variables. For n = 4, c = (13, 11, 7, 3) and 
a = (3, 7, 11, 13), while for n = 10, c = (37, 31, 29, 23, 19, 17, 13, 11, 7, 3), 
and a = (3, 7, 11, 13, 17, 19, 23, 29, 31, 37) and for n = 15 

a = (3, 7, 11, 13, 17, 19, 23, 29, 31, 37, 41, 43, 47, 51, 53) 

and c = (53, 51, 47, 43, 41, 37, 31, 29, 23, 19, 17, 13, 11, 7, 3). 

The right-hand-side b is taken into [ — |a|,|a|] n Z. Figure [T] displays 
the difference min Q+ — min LP where the lower bound min LP is obtained 
by relaxing the integrality constraints x G {—1,1}” to the box constraint 
X G [—1,1]” and solving the resulting LP. On the x-axis one reads b + |a|. 
As expected the lower bound minQ_|_ is much better than minLP. In fact 
the cases where the LP-bound is slightly better is for right-hand-side b such 
that the relaxation provides the optimal value /*. 





Figure 1. Difference minQ+ — minLP with n=(4,10,15); 
One reads b + |a| on the x-axis 


Moreover Figure [2] displays the difference min Q+ —min Q-|_ where min Q+ 
is the optimal value of the first SDP-relaxation of the Lasserre-SOS hierarchy 
applied to the initial formulation ()3.1I) of the knapsack problem where one 
has even included the redundant constraints Xj (a^x — 6) = 0, z = 1,..., n. 
One observes that in most cases the lower bound min Q-(_ is slightly better 
than min Q+. 

This is encouraging since the Lasserre-SOS hierarchy BM is known to 
produce good lower bounds in general, and especially at the first level of 
the hierarchy for MAX-CUT problems whose matrix Q of the associated 
quadratic form has certain properties, e.g., Qij > 0 for all z, j or Q ^ 0 (in 
the maximizing case); see e.g. Marshall m- 









Figure 2. Difference minQ+ — minQ_|_ (n=10) (left) and 
relative difference 100 * (minQ-i. — minQ_(_)/minQ_|_; One 
reads b + |a| on the x-axis 

Example 3.2. In a second sample of linear knapsack problems (|3.ip with 
n = 10,15, we have chosen the same vector a as in Example 13.11 but now 
with a cost criterion of the form c(z) = a{i) + sr], i = 1,... ,n, where r] 
is a random variable uniformly distributed on [0,1], and s is a weighting 
factor. The reason is that knapsack problems with ratii c{i)/a{i) ~ 1 for 
all i, can be difficult to solve. As before the right-hand-side b is taken into 
[ — |a|, jaj ] nZ. Figure [3] displays results obtained for s = 10, and n = 10,15. 




Figure 3. Difference minQ+ — minLP, c = a -|- 10 * 
(n=10,15); b+ |a| on the x-axis 


Finally, as for Example 13.11 Figure 0] displays the difference min Q+ — 
minQ_|_ (where minQ+ is the optimal value of the first SDP-relaxation of 
the Lasserre-SOS hierarchy applied to the initial formulation ()3.ip of the 
knapsack problem where one has even included the redundant constraints 
Xi (a^x — 5) = 0, i = 1,..., n). Again one observes that in most cases the 
lower bound minQ+ is slightly better than minQ+. 

Example 3.3. We next consider the same knapsack problems (|3.ip as in 
Example 13.21 but now with quadratic criterion c^x -|- x^Fx, again with a 
cost criterion of the form c{i) = a{i) sr], i = 1,... ,n, where rj is a random 
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Figure 4. Example 13.21 Difference minQ^ — minQ+, 

(n=15) c = a + 20r/ (left) and c = a + lOr/; b + |a| on the 
x-axis 

variable uniformly distributed in [0,1]. The real symmetric matrix F is also 
randomly generated and is not positive definite in general. Again in Figure 
[5] one observes that the lower bound min Q+ is almost always better than 
the optimal value minQ_|_ of the first level of the Lasserre-SOS hierarchy 
applied to the original formulation (j3.1h of the problem. 



Figure 5. Example 13.31 Difference minQ^ — minQ+, 

(n=15) c = a + 10??; b + |a| on the x-axis 

3.2. Larger size problems: The fc-cluster problem. As generating data 
(c, a, 6) for difficult 0/1-knapsack problems of larger size is not obvious, we 
next consider the so-called k - cluster pmhlem in = 70 and ?? = 80 variables: 

(3.2) min { x^Ax : e^ x = /c; x € {0, l}'^ }, 

where A: G N is a fixed parameter, e = (1,1,..., 1) G M"', A G with 

A = A^ and An = 0 for all i = 1,... ,n. Indeed the constraint e^x = A: of 
the A:-cluster problem is structural and does not depend on a vector a as in 
knapsack examples. After the change of variables x—)-(x-|-e)/2 the A:-cluster 
problem reads: 

(3.3) P : min { 2e^Ax -I- x^Ax : e^x = 2A: — n; x G {—1,1}” }. 
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We have compared the optimal value fmaxcut the Shor relaxation of the 
MAX-CUT formulation (j2.4[) of (j.S.Sp with the optimal value for the 

first semidefinite relaxation of (13.3p in the Lasserre-SOS hierarchy. The 
latter is a rather basic quadratic relaxation of the initial problem. In all our 
experiments with n = 70 and n = 80, both values are almost identical since 
the relative difference is no more than 0.014% and 0.06% respectively. 

Of course when k > n the /c-cluster problem (13.3p has no feasible solution 
to P. In view of the special structure of the /c-cluster problem it is straight¬ 
forward to check that the first semidefinite relaxation of ()3.3p (or equiva¬ 
lently of (13.21) 1 in the Lasserre-SOS hierarchy is infeasible, hence certifying 
that f* = -|-oo. On the other hand the Shor relaxation of the MAX-CUT 
formulation of (j3.3p has always a finite value. However, one may prove that 
if fe > n then the optimal value is larger than /3(c, F), which by Proposition 
12.31 also certifies that f* = -|-oo. That is, for the fe-cluster problem (|3.3I) the 
Shor relaxation of its MAX-CUT formulation (j2.4p also detects infeasibility. 

Comparing with a quadratic convex relaxation. Decompose A as 
U^AU with U^U = I (the identity matrix) and A is the diagonal matrix 
of eigenvalues of A. Let 6 := |Amm(A)| -|- 1 where Amm(A) is the smallest 
eigenvalue of A. Replace A with A := U^(A -|- 0I)U so that the resulting 
the quadratic form x i—)■ x^Ax is convex. Then observe that 

min { 2e^Ax -|- x^Ax : e^x = 2fe — n; x € {—1,1}” } = f* + n9 

because x^Ax = x^Ax -|- 0||x|p and xf = 1 for all i = 1,..., n. Therefore 
one may compare the optimal value fmaxcut of Shor relaxation of (j3.3p 
with ip = Ip — nO, where 

Ip = min { 2e Ax -|- x Ax : e x = 2A; — n; < 1, i = 1,..., n }, 

which is a convex quadratic relaxation. Results displayed in Table [U show 
that the Shor relaxation is always better, and sometimes significantly better. 
However this convex relaxation is rather weak. 

Next we do the same comparison for a /c-cluster problem where some 
sparsity is introduced in the cost matrix A. Namely once A has been gen¬ 
erated then for each non-diagonal entry Ajj we decide Ajj = Aji := 0 with 
probability 0.4, 0.7 and 0.8. Results displayed in Table [2] for n = 100 show 
that again the Shor relaxation is always better (and some times significantly 
better) than the quadratic convex relaxation. The sparser is A the more 
efficient is the Shor relaxation compared with the quadratic convex relax¬ 
ation. 
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p 

II 

o 

k=50 

k=45 

O 

II 

k=35 

o 

CO 

II 

k=25 

J maxcut 

Ip 

_ i _ 

2324.68 

2260.00 

2.86% 

1350.74 

1278.08 

5.68% 

488.83 

410.48 

19.08% 

-261.78 

-343.95 

23.89% 

-900.55 

-985.57 

8.62% 

-1429.66 

-1514.77 

5.61% 


Table 1. fc-cluster: Shor relaxation {fmaxcut) convex qua¬ 
dratic relaxation (^ijj = ijj — nO) with n = 70 


n=100 

O 

II 

O 

II 

k=50 

O 

II 

II 

to 

o 


Ajj = 0 with probability 0.8 


J maxcut 

Ip 

b 

513.32 

419.07 

22.4% 

-60.83 

-147.77 

58.8% 

-450.91 

-572.27 

21.2% 

-781.84 

-894.72 

12.6% 

-1084.98 

-1188.59 

8.7% 


Ajj = 0 with probability 0.6 


J maxcut 

Ip 

b 

1278.01 

1192.99 

7.1% 

256.43 

155.44 

64.9% 

-627.72 

-723.34 

13.2% 

-1248.39 

-1372.94 

9.0% 

-1988.94 

-2095.66 

5.0% 


Table 2. fc-cluster: Shor relaxation {fmaxcut) convex qua¬ 
dratic relaxation = ip — nO) with n = 100. Ajj = 0 with 
probability p = 0.8,0.6. 


3.3. Comparing with the copositive formulation. As already men¬ 
tioned in the introduction, the 0/1 program (jl.ll) also has a copositive for¬ 
mulation. Namely, let = (hi=j) G K”, i = 1,..., n, and e = (!,...,!) € 
M"’. Following Burer [H p. 481-482], introduce n additional variables 
z = (zi,..., Zn) and the n additional equality constraints Xi + Zi = 1, 
i = 1, ... ,n, with z > 0 (which are necessary to obtain an equivalent formu¬ 
lation). So let and with I € being the identity 

matrix, introduce the real matrices 


F 


F 0 
0 0 ’ 


A 0 

I I 


and the real vectors := (c'^,0) G R^” and = (b'^,e'^) G R”^+"’. Let 
Si denote the Lth row vector of S, i = l,...,2n. Then the copositive 
formulation of (jl.ip reads: 


(3.4) 


f* = min 

s.t. 


(F,X) 

Sii = bi; SiXSf = b2, 
^22 — ^ 2 ? ^ 271 , 


1 = 1,..., 771 -|- n 

1 

X X 


G C 


2n+l ’ 
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where C 2 n+i is the convex cone of (2n + 1) x (2n + 1) copositive matrices 
and C 2 n+i is its dual, i.e., the convex cone of completely positive matrices. 

The hard constraint being membership in ^2n+l! a strategy is to use hier¬ 
archies of tractable approximations (of increasing size) of C^n+i, as described 
in e.g. Diir [6]. In particular a possible choice for the first relaxation in such 
hierarchies is to replace (j.l.dp with the semidefinite program: 

(3.5) 


fcopo = ^in c^x + (F,X} 

s.t. S,x = b,-; S,XSr = b? 


Xjj — Xj, 


i = 1,..., 2n; 


i = 1, 
1 x^ 
X X 


.., m -|- n 
^ ‘^^+1 hl-^2n-|-l) 


where (resp. Af 2 n+i) is the convex cone of real symmetric positive 

semidefinite (resp. entrywise nonnegative) matrices. Then ()3.5p is a semi- 
dehnite relaxation of (|3.4p because C^n+i C 5^^^nA/2n+i, and so f*opo < /*• 


Example 3.4. We have considered the /c-cluster problem (|3.2p with n = 50 
variables and where F is randomly generated with 80% of zero entries in F. 
Then we compared the optimal values f^axcut and f*opo of the respective 
Shor-relaxations of the MAX-CUT formulation (12.4p and the copositive for¬ 
mulation of (j3.2p . For most values of k the lower bound fmaxcut ''^as almost 
identical to (the relative difference A := 100 (f^axcut “ fcopo)/fcopo be¬ 
ing at most 0.1%), and was better (A = 68% and 44%) for small fc = 12 
and /c = 14 respectively. However notice that the size of the semidefinite 
constraint in the latter is twice as large as the one in the former. 


Remark 3.5. Notice that in all examples the bounds fmaxcut and (re¬ 
spectively denoted minQ+ and minQ+ in Section 13711) are almost identical. 
It might be tempting to conjecture that they are indeed identical and the er¬ 
ror is coming from numerical roundoffs. However results displayed in Figure 
[5] show that the difference minQ^. — minQ+ is not uniformly distributed. 


4. Conclusion 

In this paper we have shown that a linear or quadratic 0/1 program P 
has an equivalent MAX-CUT formulation and so the whole arsenal of ap¬ 
proximation techniques for the latter can be applied. In particular, and 
as suggested by some preliminary tests on a (limited sample) of 0/1 knap¬ 
sack and A:-cluster examples, it is expected that the lower bound obtained 
from the Shor relaxation of this MAX-CUT formulation will be in general 
better than the one obtained from the standard LP-relaxation (for linear 
0/1 programs) of the original problem. The situation might be even bet¬ 
ter for quadratic 0/1 programs when the Shor relaxation of the MAX-CUT 
formulation is compared with a convex quadratic relaxation. 
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